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PREFACE 

Since  1970,  research  has  been  carried  out  at  SRI  to  develop  methods 
for  automatically  measuring  the  cloud  motions  shown  in  sequences  of  pic- 
tures from  geosynchronous  weather  satellites.  This  work  was  begun  under 
sponsorship  of  the  U.S.  Navy  Project  FAMOS  and  has  been  continued  under 
contract  to  the  Naval  Environmental  Prediction  Research  Facility.  The 
intended  application  is  to  furnish  input  data  for  the  numerical  weather- 
forecasting models  used  at  the  Fleet  Numerical  Weather  Center. 

Under  the  present  contract,  a companion  document  to  this  report  is 
also  being  prepared.  It  is  entitled  "User's  Guide  for  Running  the  SATS 
Programs  on  SPADS."  This  user's  guide  documents  the  steps  necessary 
to  execute  the  SRI  Automatic  Tracking  System  (SATS)  on  the  ^ATDAT  Pro- 
cessing And  Display  £ystem  (SPADS)  at  Monterey,  California.  Practical 
steps  are  listed  for  operating  the  console  and  interactively  modifying 
system  parameters,  as  well  as  using  and  interpreting  the  results. 


I INTRODUCTION 


In  an  earlier  paper,  we  described  rhe  formulation  and  preliminary 
testing  of  an  automatic  system  for  tracking  clouds  that  are  shown  in 
sequences  of  pictures  from  geosynchronous  weather  satellites  (Endlich 
et  al.,  1971).  The  system  was  based  in  part  on  the  ISODATA  computer 
program  developed  by  Ball  and  Hall  (1967) . ISODATA  is  a general-purpose 
pattern  recognition  technique  that  subdivides  data  into  groups  or  clusters 
(under  the  control  of  certain  preselected  parameters)  and  also  locates 
group  centers.  By  tracking  the  centers  of  brightness  of  cloud  groups  (as 
identified  by  ISODATA),  cloud  motions  may  be  determined.  Wolf  et  al. 
(1973)  reported  further  tests  of  the  method  which  included  comparisons 
with  human  tracking  performed  using  the  SRI  electronic  cloud  console 
(Serebreny  et  al.,  1970).  These  comparisons  showed  that  the  automatic 
method  performed  rather  satisfactorily  for  cases  where  only  a single 
layer  of  clouds  existed  in  the  scene.  A major  difficulty  was  that  the 
computer  program  produced  a sizable  proportion  (approximately  15  to  20 
percent)  of  spurious  motions.  These  errors  were  caused  mainly  by  the 
random  changes  in  size,  brightness,  and  shape  associated  with  the  dynamic 
nature  of  clouds.  One  of  the  main  tasks  of  a human  analyst  in  tracking 
clouds  is  to  ignore  this  randomness  and  select  representative  tracers 
for  tracking.  Recent  improvements  to  the  programs  have  reduced  the  spu- 
rious vectors  to  a small  proportion  of  the  total  number.  This  report 
describes  the  present  programs  with  emphasis  on  the  automatic  tracking 
system,  and  shows  results  obtained  using  brightness  data  alone,  IR  data 
alone,  and  also  a combination  of  brightness  and  IR  data.  The  report  is 
intended  to  aid  NEPRF  personnel  in  evaluating  the  programs  using  the 
SPADS  computer  system  at  Monterey. 

The  overall  goal  of  this  work  is  to  develop  an  automatic  cloud- 
tracking system  that  is  accurate,  applies  to  a wide  variety  of  weather 
situations  (including  those  having  two  or  more  cloud  types  in  the  scene) , 
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Is  fast  and  economical,  makes  use  of  the  excellent  quality  of  both  visible 
and  IR  satellite  data  now  being  obtained  on  a routine  basis,  and  requires 
little  human  control. 


The  SRI  cloud-tracking  system  differs  from  those  at  the  University 
of  Wisconsin  (Smith,  1975)  and  the  Goddard  Space  Flight  Center  mainly  in 
using  automatic  rather  than  human  selection  of  trackable  cloud  groups, 
and  in  using  a pairing  program  (described  later)  rather  than  cross- 
correlation guided  by  a human  analyst  to  compute  motion  vectors.  The 
NESS  automatic  tracking  method  (Leese  et  al.,  1971;  Green  et  al.,  1975) 
uses  a cross-correlation  method  of  computation  but  does  not  use  target 
selection.  All  these  systems  are  under  continuing  development. 

We  do  not  expect  that  automatic  methods  are  likely  to  replace  human 
analysts  where  weather  processes  and  cloud  motions  are  most  complex,  or 
In  detailed  research  studies  of  the  type  made  by  Fujlta  et  al.  (1968), 
Hubert  and  Whitney  (1971),  Smith  and  Hasler  (1976),  Bauer  (1976),  and 
others.  The  purpose  of  using  objective  methods  is  primarily  to  cope 
with  the  tremendous  volume  of  satellite  data  in  a routine  fashion  to  ob- 
tain cloud  motion  vectors  suitable  for  use  in  numerical  prediction  models. 


II  OUTLINE  OF  THE  METHOD 


A general  theoretical  overview  of  the  method  is  given  in  the  Appendix. 
Here  we  will  describe  the  specific  procedures  followed.  The  first  step 
in  the  process  is  to  select  a small  portion  of  a cloud  photograph  at 
Time  1,  and  the  corresponding  area  in  the  next  photograph  at  Time  2. 

This  is  done  after  landmarks  have  been  used  to  give  a first-order  (trans- 
lational) correction  to  register  the  pictures.  (Further  corrections  are 
introduced  at  a later  stage.)  The  areas  are  typically  a few  hundred  miles 
on  a side.  Next,  on  each  picture  the  relatively  bright  portions  of  the 
data,  as  compared  to  the  immediate  surroundings,  are  saved  and  the  re- 
mainder is  discarded.  To  identify  the  tracers,  the  saved  data  of  Pic- 
ture 1 are  subdivided  into  cloud  groups  or  clusters.  Each  group  is  a 
potential  tracer.  Typically  there  will  be  25  to  50  groups  in  the  scene. 

For  each  group,  several  characteristics  are  computed  including  the  loca- 
tion of  its  center,  its  size,  average  brightness,  and  average  IR  tempera- 
ture (when  available).  Picture  2 is  treated  in  the  same  way.  In  the 
remainder  of  the  computer  processing  the  original  data  are  ignored,  and 
only  the  information  about  the  groups  is  retained.  This  represents  a 
reduction  of  the  original  information  to  a very  small  amount.  Next,  the 
MOTION  program  uses  the  descriptors  of  groups  at  Times  1 and  2 to  match 
the  groups  in  pairs,  thereby  giving  cloud-displacement  vectors  over  the 
time  Interval  between  pictures.  The  matching  is  done  in  an  iterative 
computation.  A matched  group  is  required  to  exhibit  continuity  in  size, 
brightness,  shape,  and  IR  temperature.  Moreover,  each  vector  (defined 
by  a matched  pair)  must  conform  within  certain  limits  to  the  predominant 
motion  (average  of  all  those  selected).  Usually,  less  than  half  the 
centers  will  be  matched.  After  one  set  of  vectors  has  been  identified, 
the  remaining  group  centers  can  be  reprocessed  to  compute  a second  set 
of  vectors  of  a different  speed  or  direction  from  the  first  set.  A 
second  set  will  exist  if  there  are  two  distinct  cloud  layers  in  the 
scene.  The  final  steps  are  to  convert  the  motions  from  picture 
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coordinates  (rows  and  columns)  to  earth  coordinates  (latitude,  longitude, 
cloud  speed  and  direction),  and  to  assign  an  altitude  to  them,  depending 
on  their  brightness  and  IR  temperature. 
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III  PRESENT  PROCEDURES 


A.  Landmark  Matching 

Landmarks  are  located  on  the  pictures  at  the  point  of  best  fit 
using  a correlation  technique.  The  computation  is  similar  to  that  used 
by  the  NESS  and  University  of  Wisconsin  groups,  with  the  difference 
that  clouds  are  thresholded  out  of  the  computation  by  eliminating  bright- 
ness values  above  an  appropriate  upper  limit  for  land.  In  this  approach, 
the  fast  Fourier  transform,  which  is  very  efficient  computationally, 
cannot  be  used.  However,  this  loss  is  overcome  to  a large  extent  by 
using  a search  routine  that  avoids  finding  correlations  at  all  points. 

In  the  search,  a coarse  scan  jumps  the  landmark  template  over  the  search 
area  to  identify  the  best  locations  from  which  to  start  a fine  scan, 
which  then  locates  the  final  position  of  best  match.  Further  details  are 
given  by  Wolf  et  al . (1973). 

B.  Separation  of  Clouds  from  Background 

Separating  brightness  values  that  belong  to  trackable  cloud  groups 
from  background  values  is  a major  problem.  The  brightness  values  (points) 
that  are  retained  must  be  well-clustered  and  trackable.  By  well-clustered, 
we  mean  that  they  should  form  tight  groups  in  which  points  belonging  to  a 
group  are  close  together  and  separated  from  other  groups.  By  trackable, 
we  mean  that  each  group  is  unique  (in  size,  shape,  and  brightness),  and 
the  unique  group  is  recognizable  over  at  least  two  frames.  Also,  these 
groups  of  brightness  values  should  be  distributed  over  the  cloudy  areas 
of  the  region  being  processed  so  that  cloud-motion  vectors  will  cover  the 
area.  Insofar  as  possible.  Finally,  tc  minimize  computation  time  we 
want  to  retain  only  enough  points  to  adequately  describe  the  clouds. 

The  CLOUDS  program  performs  these  functions.  It  normally  works  with 
an  area  (selected  from  data  tapes)  that  is  120  horizontal  units  (columns) 
by  70  vertical  units  (rows).  The  size  of  a brightness  element,  in  terms 
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of  original  picture  elements,  Is  a variable  that  permits  experimentation 
with  various  resolutions.  Since  the  ATS-III  data  tapes  (recorded  In 
Rosman  format)  have  8192  columns  along  a line  and  2400  lines  per  picture, 
for  these  data  we  use  a ratio  of  3 column  elements  to  1 line  element  In 
making  up  a brightness  unit  that  covers  roughly  a square  area.  Thus 
typical  unit  sizes  are  3 by  1,  6 by  2,  9 by  3,  etc.  (all  column  elements 
by  row  elements).  Close  to  the  subsatelllte  point,  these  units  corre- 
spond roughly  to  a square  3 miles,  6 miles,  or  9 miles  on  a side.  Thus 
total  coverage  of  the  120  by  70  area  Is  approximately  360  by  210  miles, 

720  by  420  miles,  or  1080  by  630  miles.  The  smaller  unit  takes  more 
repetitions  of  the  cloud-motion  computation  subsystem  In  order  to  cover 
a given  geographical  region.  Each  repetition  produces  about  the  same 
number  of  cloud-motion  vectors  (typically  10-20  vectors  per  repetition), 
so  the  higher  resolution  data  produce  more  closely  spaced  vectors.  The 
price  paid  for  higher  resolution  Is  simply  more  computer  time. 

The  simplest  method  of  separating  trackable  clouds  from  background 
Is  to  select  the  brightest  elements  In  the  scene  and  discard  the  remainder. 
This  can  be  accomplished  easily  by  forming  a cumulative  count  of  the 
number  of  brightness  values  greater  than  or  equal  to  a given  gray-scale 
value.  A threshold  Is  picked  from  the  cumulative  count  that  gives  a 
prespecified  number  of  points.  Several  examples  are  given  by  Wolf  et  al. 
(1973)  which  show  that  selecting  the  brightest  elements  does  well  as  long 
as  clouds  In  different  parts  of  the  region  have  approximately  equal  bright- 
ness. However,  If  a very  bright  cloud  Is  In  one  part  of  the  region  with 
dimmer  clouds  over  the  remainder,  this  procedure  will  select  only  the 
bright  cloud.  Hence  cloud  tracking  will  reflect  the  motion  of  the  bright 
cloud  only,  and  the  motions  of  other  clouds  will  be  lost. 

A method  that  overcomes  this  problem  is  to  vary  the  threshold, 
depending  on  the  relative  brightness  of  a small  area  of  the  scene.  Bright- 
ness values  greater  than  the  average  of  nearby  values  are  retained,  and 
other  values  are  discarded.  This  Is  accomplished  by  using  a 21-by-21- 
polnt  areal  average,  centered  on  the  point  of  Interest,  to  smooth  the 
picture.  This  smoothing  operator  la  run  over  the  scene;  then  positive 
deviations  from  the  smoothed  values  are  retained.  These  deviations  are 
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brighter  than  their  surroundings  and  comprise  the  trackable  targets. 

In  addition,  an  absolute  threshold  is  used  to  ensure  that  tlie  deviations 
saved  do  not  represent  land  or  ocean  background.  These  computations  are 
made  by  the  DEVIATION  program.  A minor  disadvantage  of  this  procedure  is 
tliat  a 10-polnt  margin  wltliout  deviations  is  left  around  the  edge,  reduc- 
ing the  scene  from  120  by  70  to  100  by  50  points.  To  compensate  for  this, 
the  120  by  70  areas  are  overlapped  to  give  complete  regional  coverage. 

The  results  have  been  found  to  be  verv  satisfactory  In  Isolating  track- 
able  targets  in  a variety  of  weather  situations,  including  tliose  with 
mixed  cloud  types. 

Anotiier  procedure  used  to  assure  continuity  between  pictures  is 
briglMness  normalization.  This  is  done  by  a subroutine  tiiat  computes 
cumulative  brightness  frequencies  for  Picture  1 and  tlien  for  Picture  2. 
Then  a brightness  transformation  is  made  so  that  ttie  brigl»tness  frequen- 
cies of  the  second  picture  agree  witli  tliose  of  tlie  first  as  closely  as 
possible.  This  gives  a statistical  correction  for  changes  in  illumina- 
tion tliat  occur  during  tlie  day.  Normalization  is  performed  prior  to  use 
of  the  DEVIATION  program. 

C.  Clustering  to  Identify  Croups 

The  function  of  the  clustering  process  is  to  subdivide  the  data 
into  cloud  groups  (potential  tracers) , to  count  them,  and  to  compute  the 
location  of  their  centers,  their  size,  brightness,  IR  temperature,  and 
shape.  In  earlier  work  (Endlich  et  al.,  1971;  Wolf  et  al.,  1973),  the 
ISODATA  cluster-analysis  algorithm  was  used  to  do  this.  The  results  were 
quite  satisfactory;  however,  the  computations  were  rather  lengthy.  There- 
fore the  procedure  has  been  simplified  to  give  approximately  equivalent 
results  using  a "touching  group"  algorithm:  it  is  required  that  members 
of  a group  be  touching  at  least  one  other  member  of  the  group.  Touching 
is  defined  as  being  adjacent  up  or  down,  left  or  right,  or  along  diagonals. 
Computation  of  touching  groups  is  done  by  making  several  passes  through 
the  data  from  the  DEVIATION  program  until  the  results  are  stable.  The 
process  is  fast  computationally.  Also,  a lower  limit  is  set  on  group 
size  (usually  three)  so  that  very  small  groups  (having  less  than  three 
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, groups  are  Identified,  the  following  descriptors  are  computed: 

proV'i'J  -'-'V, 

the  8ize-"(S) , the  location ‘of  the  center  (xiy),  the, average  brightness 
t\eS,S’  , ,,c  " ..  v'v-' 

(B).»,, the  average  IR  tiempe^'atai^fi  (T)»,and  two’^ measures  of\shape  (the  RMS 

ror.ti"  • ' oo-et 

dlsperaion^Or  the  group  along'x  and  y axes).  There  is  also  a provision 

. , 1,1  '.  . • U'  ' ' ' 

for  llmltlttfe  the  size  of  very  large  groups  (which  are  also  bright  groups) 

tati'  ■ j ^ 

by  ^l^inatlhg  some  of  the  dimmest  itembers.  Thus  the  brightness  and  IR 
data  In  120  by  70  arrays  are  reduced  to  a small  set  of  summary  descrip- 
tors. As  mentioned  earlier,  in  subsequent  computations  only  these 
descriptors  are  used. 


D.  Computing  Cloud-Motion  Vectors 


The  MOTION  program  has  the  function  of  matching  groups  from  two 
successive  pictures  in  a manner  that  provides  cloud-motion  vectors  that 
are  logically  and  meteorologically  acceptable.  Hall  et  al.  (1973)  gen- 
erated somewhat  idealized  Gaussian  clouds  with  controlled  displacements 
in  computer  simulations,  and  found  that  the  MOTION  program  tracked  them 
perfectly.  At  present,  the  program  uses  four  iterations.  In  the  first 
of  these,  a group  center  at  Time  1 is  matched  with  the  nearest  center  at 
Time  2,  provided  that  the  distance  between  them  is  not  larger  than  a cer- 
tain preselected  value,  determined  empirically  by  study  of  numerous  cases. 
For  all  paired  centers,  the  average  motion  (in  row  and  column  coordinates) 
is  determined.  This  average  is  used  as  an  estimate  of  the  motion  in  the 
scene.  In  the  second  iteration,  a new  pairing  is  made  in  which  the  paired 
centers  must  give  displacements  that  conform  to  the  average  displacement 
within  the  preselected  limit.  Then  a new  average  displacement  is  computed. 
In  the  third  iteration,  pairing  is  done  to  obtain  conformance  to  the  im- 
proved average  motion,  and  also  to  minimize  changes  in  the  size,  bright- 
ness, IR  temperature,  and  shape  of  groups.  In  other  words,  reasonable 
continuity  of  the  groups  is  required  in  regard  to  these  characteristics, 
which  are  also  used  intuitively  in  cloud  tracking  by  humans.  The  compu- 
tation of  suitability  of  each  potential  vector  is  made  using  a "fit 
factor."  The  fit  factor  sums  the  influence  of  the  several  characteristics 
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by  giving  each  an  appropriate  weight,  which  has  been  determined  empiri- 
cally to  give  results  that  agree  with  human  (eye)  analysis  of  the  same 
cases.  As  curreiitly  computed,  a low  value  of  the  fit  factor  is  desirable 
and  means  that  the  cloud  has  not  changed  appreciably  in  its  size,  bright- 
ness, etc.,  and  that  its  motion  conforms  well  to  the  areal  average  motion. 
Thus  the  fit  factor  is  a measure  of  the  reliability  of  each  cloud-motion 
vector,  and  if  it  is  larger  than  a preselected  value,  the  continuity  is 
poor  and  the  motion  vector  is  rejected.  The  fourth  iteration  repeats 
the  computation  as  in  the  third,  and  ensures  stable  results. 

The  fit  factor  (F)  is  computed  for  each  possible  pair  of  groups. 

We  use  the  notation  Y1  for  the  row  coordinate  of  the  group  center  at 
Time  1 and  Y2  at  Time  2,  XI  and  X2  for  the  column  coordinates,  at  the  two 
times,  B1  and  B2  for  brightness  on  a scale  from  0 to  255,  SI  and  S2  for 
the  size  (number  of  points),  T1  and  T2  for  IR  temperature,  SXl  and  SX2  for 
the  RMS  distances  of  the  group  along  the  X axis,  and  SYl  and  SY2  for  the 
RMS  distances  along  the  Y axis.  Also,  the  best  estimate  of  the  average 
cloud  displacement  in  the  scene  along  the  two  axes  is  represented  by  U 
and  V.  In  the  first  iteration  of  MOTION,  U and  V are  unknown  so  they 
are  set  equal  to  0.  If  a reliable  forecast  were  available,  this  could 
be  used  instead.  For  succeeding  iterations,  the  average  displacement 
computed  from  matched  pairs  is  used  for  U and  V. 

The  fit  factor  is  defined  as 

1/2 

F = (PI  + P2  + P3  + P4  + P5  + P6)  ' + P7  (1) 

where 

PI  = 4.0  (X2  - XI  - U)^ 


P2  = 4.0  (Y2  - Y1  - V)^ 


P3  = 25.0 


B2  - B1 
B2  + B1 


3/2 


P4 


25.0 


|S2  - Sll^^^ 
S2  + SI 
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+ (SY2  - SYl)^ 


The  multipliers  (first  terms  on  the  right  in  each  P)  are  weights  that 
have  been  set  to  give  results  matching  as  well  as  possible  those  obtained 
by  human  analysts.  A number  of  different  sets  of  satellite  data  were 
used  in  setting  the  weights.  The  dot  product  in  the  term  P7  makes  the 
cloud-motion  vector  V (which  is  being  tested  for  suitability)  conform  to 
the  areal  average  Va.  To  be  acceptable  in  defining  a cloud-motion  vector, 
a pair  must  have  a value  of  F less  than  10.0. 

One  pass  through  the  group  centers  in  a scene  identifies  the  pre- 
dominant motion.  The  group  centers  not  paired  in  this  first  pass  repre- 
sent a possible  second  set  of  motions  (if  a two-layered  cloud  system  is 
present),  plus  random  changes  in  the  scene.  A second  set  of  motions  (for 
example,  that  of  cirrus  clouds  overlying  stratocumulus)  can  sometimes  be 
identified  by  making  a second  pass  through  the  centers  not  matched  in  the 
first  pass. 


P5  = 

15.0 

|T2  - Tll^'^^ 

T2  + T1 

P6  = 

2.5  [ 

(SX2  - SXl)^ 

P7  = 

-2.0 

(Va  • V) 

IVal  + |V| 

E.  Registration  and  Transformation  to  Earth  Coordinates 

The  CORRECT  program  performs  final  registration  and  transformation 
to  earth  coordinates.  Using  several  landmarks,  it  computes  the  transla- 
tion, rotation,  X-stretching,  and  Y-stretching  needed  to  map  the  second 
picture  to  the  first  picture.  This  allows  an  apparent  earth  motion  to 
be  computed  at  the  location  of  each  of  the  observed  cloud  motions.  This 
apparent  motion  is  subtracted  from  the  observed  cloud  motion  to  give  the 
true  cloud  motion,  still  in  picture  coordinates.  Next,  using  landmark 
locations  on  an  ideal  picture,  the  CORRECT  program  determines  the  co- 
efficients used  in  equations  to  map  any  point  of  the  first  picture  onto 
the  ideal  picture.  With  these  equations,  the  picture  coordinates  of  the 
cloud-motion  vectors  are  converted  to  the  ideal  picture.  Then  a subroutine 
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Is  called  to  convert  the  vectors  to  speed  and  direction,  latitude  and 
longitude  (further  details  are  given  in  Wolf  et  al.,  1973). 

It  should  be  noted  that  at  present  there  is  a visual  step  in  this 
part  of  the  system — namely,  the  selection  of  landmarks  by  inspection  of 
pictures.  It  is  assumed  that  the  satellite  will  remain  over  a fixed  sub- 
satellite point  for  extended  periods  so  that  landmarks  once  selected  will 
be  useful  until  the  satellite  is  moved.  The  locations  of  the  landmarks 
in  terms  of  columns  and  rows  (X,Y)  are  determined  by  reproducing  pictures 
by  facsimile  with  an  X-Y  grid  superimposed  or  by  using  the  CRT  display 
system  of  the  computer.  Templates  containing  landmarks  are  roughly  60 
miles  on  a side,  i.e.,  20  by  20  picture  elements.  By  reference  to  a 
detailed  atlas,  the  latitude  and  longitude  of  the  central  (or  a corner) 
point  in  each  template  are  determined.  With  the  usual  atlases,  this  can 
be  done  only  with  an  accuracy  of  about  0.1°  latitude;  however,  this  is 
tolerable  as  it  affects  only  the  position  of  the  cloud-motion  vectors, 
not  their  magnitude  or  direction. 

The  cloud-motion  vectors  can  be  used  by  other  programs,  such  as 
the  Mancuso  and  Endlich  (1973)  objective  (gridpoint)  analysis,  for  input 
to  a weather  prediction  model,  or  they  can  be  used  for  kinematic  studies, 
such  as  those  made  by  Viezee  et  al.  (1972). 
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IV  EXAMPLES 


A.  Subtropical  Atlantic  Cumulus 

These  brightness  data  are  from  the  ATS-III  satellite  on  23  August 
1969,  and  consist  of  a sequence  of  five  pictures.  The  data  were  read 
from  tapes  and  displayed  (for  visual  checking  of  the  computations)  on 
the  CDC  280  CRT  display  system.  The  middle  picture  of  the  series  Is 
shown  In  Figure  1.  These  data  have  approximately  6-mlle  resolution  so 
the  area  covered  by  the  120  by  70  data  array  Is  approximately  700  by  400 
miles,  located  In  the  subtropics  of  the  eastern  N.  Atlantic  Ocean.  Visual 
study  of  the  sequence  using  the  electronic  cloud  console  Indicates  that 


CLOUD  COMU  COPNOm  HP  tUNT  MOI  t UPC!  KCOROCD  IP  21  WC  if 


FIGURE  1 A PORTION  OF  AN  ATS-3  GEOSYNCHRONOUS  SATELLITE  PICTURE  FOR 
23  AUGUST  1969  SHOWING  SUBTROPICAL  CUMULUS  CLOUDS 

The  area  covers  approximately  700  by  400  miles. 
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the  clouds  are  cumulus  and  stratocumulus  moving  generally  from  NE  to  SW. 
These  data  are  among  those  discussed  by  Wolf  et  al.  (1973).  For  this 
particular  scene  the  motions  obtained  automatically  at  that  time  contained 
several  spuriously  large  vectors;  therefore  the  case  was  rerun  with  the 
present  system  and  gives  satisfactory  results,  as  shown  below. 

As  mentioned  earlier,  groups  potentially  suitable  for  tracking  are 
the  locally  bright  areas  (compared  to  the  immediate  surroundings)  that  are 
organized  into  "touching  groups."  The  centers  of  touching  groups  corre- 
sponding to  Figure  1 are  shown  in  Figure  2.  With  a little  care,  they  can 
be  related  visually  to  the  features  of  Figure  1.  (No  brightness  centers 
are  placed  within  10  units  from  the  edge  for  reasons  discussed  earlier.) 
According  to  the  rules  used  in  the  MOTION  program,  only  about  half  these 
centers  have  sufficient  continuity  in  brightness,  size,  and  shape  to  be 


CLOUD  OMOX  COMtim  TIT  lICNT  m 
CTHK  Hm  K4  4 t 120  70 

mcNTicts  ccNTCts  roi  Picnac  s 


$ ms  tCCOROCD  n 2}  fWC  <9 
to  21  YES 


FIGURE  2 AUTOMATICALLY  COMPUTED  BRIGHTNESS  CENTERS  FOR  THE  VISIBLE  DATA 
OF  FIGURE  1 
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paired  and  give  cloud-motion  vectors.  The  cloud-motion  vectors  for  the 
sequence  of  pictures  are  illustrated  in  Figure  3.  Here  each  line  segment 


FIGURE  3 PLOT  OF  PAIRED  BRIGHTNESS  CENTERS  FOR  THE  SEQUENCE  OF 
PICTURES  OF  SUBTROPICAL  CUMULUS  CLOUDS 

The  lines  joining  brightness  centers  denote  cloud  displacements.  All  motion 
displacements  computed  for  the  sequence  of  five  pictures  are  shown.  Some 
brightness  centers  were  tracked  over  the  entire  sequence;  other  are  for  single 
pairs  of  pictures  only. 


is  a displacement  vector  between  the  adjacent  centers.  (However,  plotting 
is  not  done  with  the  full  precision  of  the  computations.)  There  are  a 
few  centers  that  persisted  and  were  tracked  for  the  entire  sequence  of 
five  pictures.  Other  centers  were  tracked  for  only  one,  two,  or  three 
Intervals.  The  average  of  the  73  cloud-motion  vectors  is  52°  11  m s 
and  the  variability  can  be  seen  by  inspection.  There  are  a few  vectors 
produced  by  the  program  that  appear  doubtful  since  they  differ  in  direc- 
tion or  speed  from  their  neighbors.  A relatively  small  number  of  un- 
certainties can  be  tolerated  since  an  objective  analysis  program  operating 
on  all  these  vectors  would  either  reject  the  most  unusual  ones  or  smooth 
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them  by  weighting  them  with  their  neighbors.  To  appreciate  the  density 
of  vectors  for  this  case,  one  should  note  that  in  an  area  of  this  size 
over  the  United  States,  there  are  only  about  4 or  5 radiosonde  stations. 


B.  Midlatitude  Atlantic  Stratocumulus 

This  sequence  of  four  pictures  is  from  the  SMS-GOES  satellite  on 
24  September  1974  and  consists  of  both  visible  and  IR  data  at  1500,  1530, 
1600,  and  1630  Z.  For  compatibility,  both  measurements  have  been  averaged 
to  apply  to  areas  approximately  4 miles  on  a side.  Both  the  visible  and 
IR  data  for  the  sequence  were  read  from  tapes  and  displayed  on  the  CRT 
display  system  of  the  SRI  CDC-6400  computer.  Figure  4 shows  the  visible 
and  IR  data  at  1500  Z pictorially.  The  corresponding  brightness  centers 
selected  by  the  DEVIATION  program  are  shown  in  Figure  5.  It  can  be  seen 
that  the  centers  are  distributed  not  only  over  the  brightest  clouds 
running  through  the  middle  of  the  picture,  but  also  over  some  of  the 
smaller  and  dimmer  groups  toward  the  bottom  of  Figure  4(a).  For  each 
group,  the  average  and  standard  deviation  of  the  IR  data  were  computed, 
as  were  all  other  group  descriptions  described  earlier.  The  IR  values 
are  included  in  the  pairing  decisions  made  by  the  MOTION  program.  The 
motion  vectors  computed  using  Pictures  1 and  2 of  the  sequence  are  shown 
by  the  lines  in  Figure  6.  (Centers  without  lines  are  also  shown;  these 
will  be  matched  in  the  next  computation  using  Pictures  2 and  3.  They  do 
not  indicate  zero  motions.)  The  MOTION  program  gives  a list  of  the 
vectors  where  X,  Y,  U,  and  V are  in  terms  of  rows  and  columns  of  the  120 
by  70  array,  and  brightness  and  IR  values  are  in  terms  of  original  measure- 
ments. Figure  7 shows  the  list  pertaining  to  Pictures  1 and  2 of  this 
sequence.  Only  the  vectors  indicated  by  a letter  (far  left)  were  accepted 
on  the  basis  of  the  fit  factor.  This  list  is  the  input  both  for  auto- 
matically plotting  the  vectors  in  row  and  column  coordinates  (as  shown  in 
Figure  6)  and  for  transforming  to  earth  coordinates  (program  CORRECT) . 

All  cloud  displacements  for  the  sequence  are  shown  in  Figure  8. 

There  are  52  motion  vectors  for  the  area,  which  is  approximately  480  by 
280  miles  in  dimension.  The  average  cloud  motion  is  349°  21  m s and 
the  variability  can  be  seen  in  Figure  8.  On  a scale  from  0 to  255,  the 
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FIGURE  4 A PORTION  OF  AN  SMS-GOES  PICTURE  SHOWING  MID-ATLANTIC  STRATO- 
CUMULUS  CLOUDS  COVERING  AN  AREA  OF  APPROXIMATELY  480  by  280 
MILES:  (a)  VISIBLE  DATA,  (b)  IR  DATA 
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FIGURE  5 BRIGHTNESS  CENTERS  THAT  CORRESPOND  TO  FIGURE  4(a) 
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FIGURE  6 BRIGHTNESS  CENTERS  ON  PICTURE  2 THAT  WERE  SELECTED  BY  THE  MOTION 
PROGRAM  TO  REPRESENT  CLOUD  DISPLACEMENTS 

The  lines  denote  displacements  from  Picture  1 to  Picture  2.  (Centers  without  lines 
are  matched  between  Pictures  2 and  3.) 
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FIGURE  7 COMPUTER  PRINTOUT  GIVING  A LIST  OF  THE  CLOUD-MOTION  VECTORS  SHOWN  IN  FIGURE  6 
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FIGURE  8 PLOT  OF  PAIRED  BRIGHTNESS  CENTERS  FOR  THE  SEQUENCE 
OF  PICTURES  OF  STRATOCUMULUS  CLOUDS 

Thi!  liocs  joining  brightness  centers  show  all  clourl-motion  displacements 
for  the  sequence  of  four  pictures,  computed  using  both  visible  and  IR  data. 

average  IK  measurements  for  groups  varied  only  from  65  to  80,  Indicating 
that  clouds  arc  at  low  levels.  Brightness  values  for  groups  varied  from 
69  to  162. 

C.  Intertroplcal  Convergence  Zone 

This  sequence  Is  from  the  same  data  tapes  discussed  in  Section  IV-B. 
The  area  Is  at  approximately  In  the  Atlantic  west  of  Africa,  along 
the  southern  edge  of  tfie  Intertroplcal  convergence  zone.  The  active  con- 
vection and  complex  motions  expected  here  are  In  marked  contrast  to  the 
primarily  translational  flow  of  the  previous  case.  The  visible  and  IR 
data  at  the  beginning  of  the  sequence  are  shown  pictorial ly  In  Figure  9. 
The  brightness  centers,  selected  for  groups  Identified  as  being  brighter 
than  their  nearby  surroundings,  are  numerous,  .is  shown  In  Figure  10. 

There  Is  a large  range  In  the  average  brightness  values  (from  7A  to  187) 
and  IR  values  (from  62  to  180)  for  the  different  groups.  Also,  there 
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FIGURE  9 A PORTION  OF  AN  SMS-GOES  PICTURE  SHOWING  PART  OF  THE 
INTERTROPICAL  CONVERGENCE  ZONE:  (a)  VISIBLE  DATA, 

(b)  IR  DATA 
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$H$  COES  DATA  2SSePT7M  1SOOZ  1C30Z  I^Z  U30Z  CZ2  INT  COlV 
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KICMTNCSS  CENTERS  FOR  PICTURE  1 

FIGURE  10  BRIGHTNESS  CENTERS  THAT  CORRESPOND  TO  FIGURE  9(a) 

are  considerable  changes  in  the  brightness  and  IR  values  with  time,  and 
according  to  the  rules  of  the  MOTION  program,  only  about  one-fourth  of 
the  centers  are  paired.  As  shown  In  Figure  11,  no  center  was  tracked  on 
all  four  pictures,  and  most  pairs  were  matched  for  single  time  Intervals 
only.  However,  the  cloud  displacements  show  a generally  consistent 
motion  from  the  northeast,  with  a few  essentially  zero  displacements. 
Viewed  in  animation  on  the  electronic  cloud  console,  the  computed  vectors 
agree  well  with  human  visual  judgment;  however,  a human,  given  sufficient 
time,  could  track  centers  rejected  by  the  automatic  system.  There  are 
30  vectors  in  the  approximately  480-by-280-mile  area  of  Figure  11,  with 
an  average  value  of  22°  8 m s 

Since  IR  data  are  always  available,  whereas  visible  data  are  avail- 
able only  in  daylight,  this  case  was  rerun  using  only  the  IR  data.  In 
this  mode  the  deviations  and  touching  groups  are  found  for  the  IR  data. 
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FIGURE  11  PLOT  OF  PAIRED  BRIGHTNESS  CENTERS  FOR  THE  SEQUENCE 
OF  PICTURES  OF  THE  INTERTROPICAL  CONVERGENCE  ZONE 

The  lines  joining  brightness  centers  show  all  cloud-motion  displacements 
for  the  sequence  of  four  pictures,  computed  using  both  visible  and  IR  data. 

and  the  group  centers  are  IR  centers  rather  than  brightness  centers.  As 
one  would  expect  from  the  different  appearance  of  Figure  9(a)  and  (b) , 
the  IR  centers  that  pertain  to  Figure  9(b)  are  not  identical  to  the 
brightness  centers  of  Figure  10  Cwhlch  pertain  to  figure  9(a) D.  In  par- 
ticular, in  the  lower  left-hand  portion  of  Figure  9 the  clouds  are  easily 
seen  in  the  visible  data  but  not  in  the  IR,  as  they  are  evidently  not 
much  colder  than  the  ocean  background.  In  this  region,  only  a few  IR 
centers  were  positioned  by  the  system.  The  cloud  displacements  obtained 
from  the  IR  data  alone  are  shown  in  Figure  12.  Comparison  with  Figure  11 
shows  good  agreement.  There  is  a significant  increase  in  the  number  of 
vectors  computed  using  the  IR  data,  namely  from  30  in  Figure  11  to  53  in 
Figure  12.  There  are  however,  no  apparent  differences  in  overall  accuracy 
between  Figures  11  and  12  when  the  vectors  are  evaluated  visually  on  the 
cloud  console. 
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FIGURE  12  PLOT  OF  PAIRED  IR  CENTERS  FOR  THE  SEQUENCE  OF 
PICTURES  OF  THE  INTERTROPICAL  CONVERGENCE  ZONE 

The  lines  joing  IR  centers  show  all  cloud-motion  displacerr^nts 
for  the  sequence  of  four  pictures,  computed  using  IR  data  only. 

D.  Atlantic  Cirrus 

This  sequence  is  for  subtropical  clouds  located  near  20°N  43°W, 
from  the  same  tapes  discussed  in  Section  IV-B  and  C.  As  before,  the 
data  have  approximately  4-mlle  resolution  and  the  array  covers  an  area 
approximately  480  by  280  miles  in  extent.  Inspection  of  visible  and  IR 
pictures  produced  on  the  computer  display  system  indicates  that  the 
clouds  are  predominantly  cirrus.  The  patterns  at  the  outset  are  shown 
in  Figure  13.  Cirrus  clouds  are  difficult  to  track  automatically  (and 
often  even  by  eye)  due  to  the  complexity  of  the  patterns  and  their  rela- 
tively rapid  motions.  The  numerous  brightness  centers  corresponding  to 
Figure  13(a)  are  shown  in  Figure  14;  similar  numbers  were  found  on  sub- 
sequent pictures. 

In  the  first  experiment,  pairing  by  the  MOTION  program  was  done  in 
the  usual  way,  using  U ■ V ■ 0 as  a first  guess  of  the  expected  motions. 
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FIGURE  13  A PORTION  OF  AN  SMS-GOES  PICTURE  SHOWING  SUBTROPICAL  CIRRUS 
CLOUDS,  (a)  VISIBLE  DATA,  (h)  IR  DATA 


SMS  COES  DATA  2SSePT7H  1(OOZ  1S30Z  1<OOZ  USOZ  ATLANTIC  CIRRUS 
1SOOZ  1970  990  2 2 120  70  21  YES 

•RICMT1CSS  CENTERS  fOR  PICTURE  1 

FIGURE  14  BRIGHTNESS  CENTERS  THAT  CORRESPOND  TO  FIGURE  13(a) 


Because  tlie  motions  are  fairly  rapid,  satisfactory  results  were  not 
obtained.  Then  it  was  assumed  that  in  an  operational  environment,  a 
better  first  guess  would  be  available  from  previous  history,  or  from  a 
numerical  forecast.  In  lieu  of  this,  we  made  a visual  inspection  of  the 
static  pictures.  This  indicated  that  the  true  motion  was  probably  from 
the  west,  so  the  initial  guesses  were  set  to  U = 3.0,  V = 0.0  (in  column 
and  row  coordinates).  In  this  case,  correct  results  were  obtained,  and 
for  the  first  picture  pair,  the  average  U and  V were  found  to  be  4.2  units 
and  -2.1  units,  respectively. 

For  the  sequence  of  four  pictures,  the  cloud-group  displacements 
are  shown  in  Figure  15.  A few  brightness  centers  were  tracked  on  all  four 
pictures;  however,  apparent  indications  of  longer  connected  sequences  of 
points  are  due  to  accidental  intersections  of  the  plotted  trajectories. 
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FIGURE  15  PLOT  OF  PAIRED  BRIGHTNESS  CENTERS  FOR  THE  SEOUENCE 
OF  PICTURES  OF  SUBTROPICAL  CIRRUS  CLOUDS 

The  lines  joining  brightness  centers  show  all  cloud-motion  displacements 
for  the  sequence  of  four  pictures,  computed  using  both  visible  and  IR  data. 

(This  apparent  confusion  does  not  exist  in  the  output  file  of  motions.) 
Visual  verification  of  these  motions  obtained  by  including  the  visible 
data  in  animation  on  the  electronic  cloud  console  shows  that  they  are 
quite  accurate  in  representing  the  motions  of  the  cirrus.  However,  the 
animation  shows  that  in  the  lower  right  portion  of  the  scene  there  were 
also  low  clouds  moving  at  moderate  speed  from  the  east.  Since  this 
motion  is  opposite  to  the  predominant  cirrus  motion,  the  low-level  vectors 
were  eliminated  by  the  dot  product  term  in  Equation  (1) . For  the  vectors 
of  Figure  15,  brightness  values  range  from  73  to  157,  and  IR  values  from 
61  to  187.  For  the  sequence,  the  average  cloud-motion  vector  is  from 
251°  at  18  m s"^. 

As  in  the  previous  case,  this  case  was  rerun  using  only  the  IR  data. 
For  these  cirrus  clouds,  the  IR  data  give  an  excellent  picture,  as  seen 
in  Figure  13(b).  The  IR  centers  fit  Figure  13(b)  in  exactly  the  same 
way  that  Figure  14  fits  Figure  13(a);  however,  the  two  sets  of  centers 


are  not  Identical,  as  mentioned  previously.  In  the  MOTION  program,  the 
initial-guess  values  of  U and  V were  set  equal  to  zero,  and  the  program 
was  able  to  generate  satisfactory  results,  as  shown  in  Figure  16.  (As 


FIGURE  16  PLOT  OF  PAIRED  IR  CENTERS  FOR  THE  SEQUENCE  OF 
PICTURES  OF  SUBTROPICAL  CIRRUS  CLOUDS 

The  lines  joining  IR  centers  show  all  cloud-motion  displacements 
for  the  sequence  of  four  pictures,  computed  using  IR  data. 


discussed  earlier,  for  this  case  a better  first  guess  than  zero  was  needed 
when  the  touching  groups  were  based  on  visible  data.  (This  difference  in 
performance  of  the  automatic  system  for  visible  and  IR  data  may  be  acci- 
dental.) One  cloud-motion  vector  in  the  upper  left  portion  of  Figure  16, 
indicating  motion  from  the  south  (approximately),  is  in  error.  Otherwise 
the  motions  appear  accurate  when  viewed  in  animation  with  the  IR  data  as 
background.  It  is  interesting  that  the  low  clouds  referred  to  earlier 
cannot  be  seen  in  the  IR  animation,  evidently  because  their  temperature 
is  close  to  the  ocean  temperature.  In  Figure  16  there  are  69  cloud- 
displacement  vectors,  compared  with  only  44  in  Figure  15.  This  case  of 
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V DISCUSSION 

The  method  described  herein  normally  operates  without  any  advance 
information  about  the  expected  cloud-motion  vectors  in  the  region  being 
treated,  i.e.,  the  initial  values  of  U and  V in  Equation  (1)  are  taken 
to  be  zero.  Also,  the  initial  pairing  is  done  only  within  a preselected 
search  radius  around  each  initial  center.  This  search  radius  is  defined 
in  terms  of  elements  in  the  120  by  70  data  array.  This  means  that  if  the 
motions  are  unusually  large,  the  method  may  not  be  able  to  determine  them. 

Several  procedures  can  mitigate  this  limitation.  The  first  is  to  use 
a first  guess  that  is  a reasonable  approximation  to  the  expected  cloud 
motion.  If  this  is  done,  the  search  radius  would  encompass  the  desired 
pairs,  and  a match  would  be  made.  The  first  guess  could  come  from  the 
wind  prediction  of  a numerical  forecast  model  if  our  system  were  used  in 
an  operational  mode.  A second  procedure  would  be  to  have  available  more 
frequent  satellite  data  so  that  cloud  displacements  would  be  relatively 
small  in  the  time-interval  between  pictures.  Of  course,  data  frequency  is 
ordinarily  outside  the  control  of  an  automatic  analysis  system.  The  third 
procedure  would  be  to  reduce  the  resolution  of  the  data  by  averaging  prior 
to  using  the  automatic  method.  For  example,  one  could  go  from  4-mile  to 
8-mile  resolution.  In  this  case,  the  search  radius  used  in  initial  pair- 
ing would  be  twice  as  large  as  before  (in  terms  of  earth  distances),  and 
cloud  motions  twice  as  fast  could  be  handled.  The  price  of  doing  this 
would  be  a reduction  in  the  number  of  cloud-motion  vectors  obtained  in  a 
given  geographical  area,  and  probably  also  a slight  loss  of  accuracy. 

The  values  of  U and  V from  low-resolution  data  could  then  be  used  initially 
in  a recomputation  based  on  high-resolution  data  from  which  final  results 
would  be  obtained.  Some  preliminary  computations  using  different  resolu- 
tion have  been  made  and  indicate  that  this  last  approach  is  feasible. 

The  results  of  automatic  tracking  shown  here  are  typical  of  those 
obtained  in  testing  other  representative  cases.  It  is  true,  of  course. 


that  a human  analyst,  aided  by  complex  electronic  display  devices  and 
given  sufficient  time,  could  obtain  a larger  number  of  cloud-motion 
vectors,  and  could  also  concentrate  on  those  that  are  representative,  in 
effect  eliminating  the  few  questionable  vectors  that  are  obtained  auto- 
matically. We  believe  that  the  advantages  of  automatic  computation  in 
terms  of  speed  outweigh  this  manual  advantage  and  are  of  paramount  im- 
portance in  the  long  run,  since  objective  wind-analysis  methods  can  be 
used  to  smooth  the  effects  of  a few  doubtful  cloud-motion  vectors  (e.g., 
Thomasell,  1976).  Also,  the  reliability  indicator  (fit  factor)  described 
earlier  could  be  used  as  a weighting  factor  in  objective  analysis. 

A question  outside  the  scope  of  this  study  and  not  discussed  hereto- 
fore in  this  report  concerns  the  relation  of  cloud-motion  vectors  to 
"real"  atmospheric  winds  as  they  have  traditionally  been  measured.  We 
remark  only  that  even  though  a particular  cloud  group  may  not  move 
exactly  with  the  local  winds,  it  seems  clear  that  a wind  analysis  based 
on  a number  of  cloud-motion  vectors  will  be  reasonably  representative,  if 
they  are  positioned  at  the  correct  altitude.  This  subject  is  of  course 
under  continuing  investigation  at  SRI  and  elsewhere  (e.g.,  Fujita  et  al., 
1975;  Bauer,  1976;  Davis,  1976;  Hasler  et  al.,  1976;  Hubert,  1976;  Smith 
and  Hasler,  1976). 


VI  SUMMARY 


The  system  for  cloud  tracking  described  in  this  report  (SATS)  has 
the  following  characteristics: 

• It  is  automatic.  ^ 

• It  gives  a high  density  of  vectors  in  cloudy  regions  with 
the  average  spacing  between  them  controlled  by  the  resolu- 
tion of  the  data. 

• It  can  cope  with  variable  motions  in  the  scene. 

• When  both  visible  and  IR  data  are  available,  It  makes  cloud- 
motion  decisions  using  both  of  them.  Alternatively,  it  can 
operate  separately  with  either  visible  or  IR  data. 

The  results  shown  here  indicate  that  this  system  for  measuring  cloud- 
motion  vectors  is  a major  improvement  over  previously  existing  objective 
methods,  both  in  terms  of  the  accuracy  and  number  of  cloud-motion  vectors 
obtained  and  in  terms  of  computational  efficiency.  The  values  of  bright- 
ness and/or  IR  temperature  found  for  each  cloud-motion  vector  are  useful 
in  assigning  heights  to  them.  Recently,  the  system  has  been  implemented 
on  the  SPADS  minicomputer  system  at  NEPRF.  It  is  expected  that  an 
operator  will  be  able  to  use  this  system  to  select  SMS-GOES  data  as 
desired,  to  obtain  the  automatically  computed  motions,  and  to  monitor 
their  accuracy.  We  recommend  that  the  system  be  studied  for  its  useful- 
ness in  providing  cloud-motion  vectors  for  operational  input  to  Fleet 
Numerical  Weather  Center  prediction  models,  and  for  monitoring  weather 
conditions  in  limited  areas  of  special  interest  to  Naval  activities. 
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1 MATHEMATICAL  STATEMENT  OF  THE  PROBLEM  AND  ITS  SOLUTION 


The  automatic  tracking  of  multilayered  clouds  from  satellite  images 
is  one  of  the  most  difficult  problems  in  image  science.  "Automatic" 
implies  the  use  of  a computer,  and  programming  it  to  process  images 
"intelligently"  implies  we  understand  and  can  formulate  human  vision^ 
and  the  perception  of  motion.  Therefore  there  are  many  mathematical 
problems  in  this  field  (sometimes  known  as  pattern  recognition).^  The 
main  problem  we  cover  mathematically  here  is  how  to  condense  and  trans- 
form the  vast  quantities  of  data  from  successive  satellite  Images  to 
produce  accurate  cloud  motion  vectors  within  a short  delay  after  the 
images  are  received.  This  delay  must  not  be  long  if  the  results  are  to 
be  useful  for  practical  weather  prediction.  Mathematically,  we  can 
represent  this  overall  problem  in  the  form  of  an  equation  that  formulates 
the  solution: 

V = P{I} 

where 

P symbolizes  the  computer  programs (s)  (FORMULATION) 

I symbolizes  the  satellite  image (s)  (DATA) 

V symbolizes  the  list(s)  of  vector (s)  (SOLUTION) 

The  computer  program  is  the  objective  or  automatic  process,  P^,  for 
finding  motion  vectors,  and  these  vectors  must  be  validated  by  compari- 
son with  the  subjective  results  produced  by  a person  or  persons,  P^. 
(Subscript  "s"  denotes  subjective  and  subscript  "o"  denotes  objective.) 

As  aids  to  the  subjective  judgment,  we  allow  the  inclusion  of  any  other 
measurements  of  the  atmosphere.  Including  radiosondes  and  weather  radar. 
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A.  Simplifying  Assumptions 


We  can  simplify  or  factor  the  program,  P,  into  two  separate  sections 
or  phases.  A motion  vector  is  defined  only  with  respect  to  (at  least) 
two  successive  Images: 

Ij  and  Ij 

i i+1 


These  refer  to  the  times:  T.  and  T..,.  For  each  of  these  times,  clouds 
must  be  Identified  and  located  precisely  in  the  image.  This  function 
is  performed  by  the  clustering  process,  C.  After  this,  the  two  images 
must  be  operated  on  together  (symbolized  by  the  operator ♦)  to  produce 
the  motion  vectors.  We  represent  this  factorization  mathematically  by: 


where  the  matching  or  pairing  operation,  M,  connects  corresponding 
clusters  to  provide  motions. 


The  images  we  deal  with  on  the  computer  consist  of  picture  elements 
produced  by  a hlgh-resolutlon  telescope  on  the  spin-scan  satellite.  The 
size  of  the  resolution  element  we  deal  with  represents  approximately  2 
miles  on  the  earth.  Resolution  depends  on  the  satellite  design  and  this 
governs  the  lowest  bound  on  element  size  that  we  need  consider.  Our 
problem  then  is  to  aggregate  or  collect  mathematically  these  picture 
elements  (pixels)  of  clouds  in  a meaningful  fashion,  C^,  so  that  the 
results  we  get  with  our  mathematical  process  for  aggregating  pixels  into 
larger  units  (l.e.,  clouds)  agree  with  expert  human  meteorological'* 
observers,  C^.  We  call  this  aggregation  process  clustering.  Any  one 
image  is  a static,  fixed  view  of  the  world,  and  we  must  also  consider 
how  to  enhance  the  process  to  dynamically  take  account  of  time  and 
motion,  as  well  as  the  fixed  distribution  in  space.  The  name  for  this 
adaptive  process  using  successive  static  views  is  dynamic  clustering. 
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B.  Static  Clustering 


We  next  define  the  static  clustering  process,  C,  as  operating  on  an 
Image  to  transform  It  Into  a data  list,  L,  containing  several  Items  In- 
cluding the  locations  of  the  cluster  centers.  Indexed  from  j « l,fe: 


Ctl)  - 


L 

y-i.fe 


where  fe  Is  the  number  of  cluster  centers  (clouds),  (Xy,t/y)  Is  the  Image 
coordinate  of  the  Jth  cloud  center,  and 


Is  the  standard  deviation  of  the  pixels  of  the  cluster  and  measures  the 
cloud  size.  S represents  miscellaneous  summary  statistics  such  as  all 
pairs  of  Intercluster  distances  and  the  number  of  pixels,  n,  contributing 
to  each  cloud,  etc. 

The  ISODATA  clustering  process,  C (ISODATA  Is  a particular  clustering 
algorithm  whose  development  was  begun  In  1965  at  SRI),  Is  Iterative,  but 
It  may  be  "Instructed"  to  settle  to  a static  condition  by  the  "settling 
process,"  In  which  transmigration  of  pixels  from  one  cluster  to  another 
Is  eventually  ended.  This  usually  occurs  after  about  three  Iterations  of 
the  Image  data  through  the  ISODATA  process  on  the  computer,  provided  no 
control  parameters  of  the  program  are  externally  disturbed.  The  program 
parameters  are  the  means  by  which  the  user  guides  the  computational  pro- 
cess to  adapt  to  his  needs. 

The  static  part  of  the  clustering  Is  locating  or  Identifying  the 
clouds,  and  since  these  are  usually  the  brightest  features  In  the  Image, 
brightness  of  the  elementary  pixels  Is  the  prime  variable  Identifying  a 
cloud. 


Since  we  are  Interested  In  tracking  clouds,  we  must  first  apply 
some  function  of  this  brightness  (or  radiance.  In  the  case  of  an  Infrared 
Image)  to  eliminate  background  pixels.  If  Is  the  total  number  of 
pixels  in  the  original  (total)  image.  Including  background,  then  the 
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total  number  of  pixels  retained  In  the  reduced  or  partial  image  is  n^, 
where  See  Figure  1. 


i - 1 i - 8196 


FIGURE  1 DIAGRAM  OF  WHOLE  IMAGE,  SHOWING 
SPECIFIC  RESOLUTION  DETAILS  FOR 
ATS-3  SATELLITE 


Several  separating  algorithms.  A,  have  been  evaluated,  to  Include  or 
exclude  each  pixel,  i..  The  simplest  algorithm  uses  a fixed  brightness 
threshold.  It  is  convenient  to  define  a binary  variable,  6^,  for  each 
pixel,  as: 

1 

= j A{I} 

0 


Then 

^-1 

The  simple  fixed-threshold  (0)  algorithm  is  represented  mathematically  by 
0»  where  B.  is  the  brightness  at  the  -tth  pixel. 
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Obviously,  not  every  bright  pixel  is  a separate  cloud,  so  we  aggre- 
gate, average,  or  cluster  the  pixels  into  cluster  centers.  Assume  that 
there  is  one  cloud  or  cluster  in  the  image;  its  location  is  defined  by 
our  process  to  be  at  image  coordinates,  where 


X 1 


b .X  . t/  - —^5^  b .y. 

-t“l  -t“l 

and  X.  counts  only  the  pixels  in  the  selected  image 
measured  by 


The  spread  is 


2 

a — = — 
X n. 


x-1 


i.(^.  - x)' 


and  similarly  for  o— . 


However,  it  is  not  realistic  to  assume  only  one  cloud  in  the  image, 
and  because  of  the  large  variations  encountered  in  practice,  both  as  to 
shape  and  extent  of  cloud  coverage,  the  adaptive  process  searches  for  and 
finds  the  locations  of  an  appropriate  number,  fe,  of  clouds  (approximately 
15  or  20  per  image,  determined  by  reasonable  use  of  computer  time)  to 
represent  any  image.  Thus,  the  prime  function  of  the  static  clustering 
process  is  counting  and  locating  the  centers  of  significant  clouds. 

The  adaptive  search  process  of  ISODATA,  and  the  parameters  used  to 
guide  it,  will  not  be  discussed  in  detail  here,  as  there  have  been  a 
number  of  publications  describing  them. At  SRI,  Dan  Wolf  has  recently 
been  using  a special-purpose  "touching"  algorithm  that  finds  suitable 
centers  and  also  reduces  computation  time  compared  with  the  full  cluster- 
ing algorithm. 


C.  Dynamic  Clustering 

The  motion  program,  M,  produces  a ranking,  R,  of  vectors  from  the 
clustering  results.  (For  conceptual  simplicity  and  concise  description, 
we  shall  continue  to  use  I as  the  selected  image  as  well  as  the  original 
image,  ignoring  the  background.)  Thus 


ij 
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assuming,  for  simplicity  of  this  formulation,  that  k Is  the  same  number 
of  clusters  found  at  times  1 and  2.  F is  a fit  factor  computed  for  each 
vector,  /,  and  defined  heuristlcally  as  the  following  combination  of 
statistical  descriptors  (derived  from  the  clustering,  and  Implied  by  the 
previously  defined  quantity,  S) : 


F 


2 2 2 2 
W Ax  + W At/  + W_AB  + W„AR 
X y B R 


+ w / — ^ + w ( 
”ri  ”2/ 


Ao^  + Aa^  + Ao^  + 


where 

W is  the  weight  for  the  respective  factors 

A stands  for  the  difference  In  the  respective  statistical 
descriptors  of  a pair  of  cluster  centers 

X Is  the  measurement  In  Image  units  In  the  east-west  direction 
(as  before) 


y is  the  measurement  in  Image  units  in  the  north-south  direction 
(as  before) 

B is  the  average  brightness  of  a cluster  (0  to  255) 

R Is  the  average  Infrared  temperature  of  a cluster  (160  to 
330  degrees  Kelvin) 

n is  the  number  of  points  in  a cluster  (in  particular,  ni  is  the 
number  of  points  In  the  cluster  at  time  1 and  n2  Is  the  number 
of  points  In  the  cluster  at  time  2) 

o Is  the  standard  deviation  of  the  various  quantities  (o^  Is  the 
standard  deviation  In  the  east-west  direction,  Oy  Is  the 
standard  deviation  In  the  north-south  dlrectlon,^and  so  forth) 
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II  COMPUTATIONAL  EXPERIMENTS 


The  data  image  consists  of  a global  view  of  the  whole  earth,  with 
sea,  land,  and  air.^  This  is  real  data  for  our  experiments,  because  it 
is  the  ultimate  application  for  which  the  program  is  Intended.  Our  task 
is  to  match  a program  to  this  data,  to  give  useful  meteorological  results. 
However,  it  may  be  more  natural  for  the  program  to  process  other  data, 
obtained  hypothetically  from  a mathematical  model  or  concept.  We  have 
artificially  generated  such  data  for  our  experiments,  to  simulate  clouds. 
The  benefit  of  artificial  data  is  that  its  basic  characteristics  of 
motion  are  perfectly  known,  by  construction.  See  Figure  2. 

A.  Experimental  Method 

The  method  of  conducting  our  experiments  has  been  to  generate  arti- 
ficial data  (representing  clouds)  and  then  to  process  these  data  using  the 
dynamic  clustering  program  to  see  if  the  computer  can  recover  the  same 
motion  information  from  the  data  that  we  used  to  generate  it.  This  method 
is  sound  because  it  is  complete,  having  a closed-loop  form.  Discrepancies 
that  arise  between  the  two  sources  of  information,  at  the  input  and  out- 
put of  the  closed  loop,  denote  errors  in  the  dynamic  clustering  program. 

If  the  errors  are  statistically  significant,  modifications  to  the  program 
are  necessary.  Sometimes  the  errors  are  of  a gross  kind,  but  often  the 
search  for  a remedy  requires  introspection  concerning  the  nature  of  the 
human  visual  tracking  process  and  how  to  describe  this  within  the  prac- 
tical limitations  of  the  computer  system.  The  commands  Implemented  in 
the  data-generating  language  are  not  discussed  here,  but  have  been 
published.^  A high-performance  CRT  display  connected  to  a PDF  11,  and 
line-printer  plots  from  a CDC  6400  computer,  have  been  used  for  this 
work. 


B.  Tracking  More  Complex  Artificial  "Clouds” 

We  have  reported  tracking  39  clouds  simulating  the  Intertropical 
Convergence  Zone.®  These  "clouds"  were  tracked  by  the  computer  program 
and  by  human  observers  on  the  SRI  cloud  console.  Agreement  between  man 


45 


FROM  SATELLITE 
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FIGURE  2 DIAGRAM  OF  EXPERIMENTAL  METHOD  FOR  ADAPTING  THE  PROGRAM 
TO  REAL  AND  ARTIFICIAL  IMAGES 
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and  machine  was  very  good  for  motion  vectors.  We  have  also  reported 
tracking  simulated  infrared  imagery.^  These  results,  although  of  great 
Interest,  are  not  easy  to  display  graphically  In  this  paper.  It  is 
necessary  to  Inspect  the  printout  (or  the  report  containing  extracts  of 
printout)  to  appreciate  the  finer  points  of  these  more  complex  experi- 
ments . 

C.  Tracking  ATS  III  Images 

On  a related  project  we  have  carried  out  a detailed  comparison  of 
the  cloud  vectors  produced  by  humans.  An  area  off  the  west  coast  of 
Africa  was  selected  for  these  comparisons,  using  five  frames  of  real 
satellite  data  taken  on  23  August  1969.  There  were  66  clouds,  clusters, 
or  tracers,  identified  and  tracked,  using  both  objective  program  and 
the  average  of  four  subjective  human  trackers  P^.  Although  the  result^*' 
showed  that  objective  tracking  by  computer  was  quite  good,  some  recent 
improvements  have  resulted  in  even  better  performance.  The  first  improve- 
ment was  gained  by  an  adjustment  of  the  weights,  UJ  (given  earlier  in 
the  equation  for  the  fitting  factor  F) . This  Improvement  was  made  by 
Roy  Endlich,  based  on  his  meteorological  observations  using  the  cloud 
console  and  his  familiarity  with  the  inner  workings  of  the  program.  The 
second  Improvement  was  due  to  the  introduction  of  a "touching"  method  for 
finding  centers.  These  improvements  are  summarized  in  the  following 
tabulation,  for  199  possible  vectors: 

i' 

I; 

i 

Correct  Incorrect  Rejected  | 

Results,  1973  147(74%)  34(17%)  18(  9%)  t 

Results,  1976  168(84%)  3(1.5%)  28(14%) 


I 
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III  DEVELOPMENT  OF  NEW  ADAPTIVE  SYSTEM  (SPADS) , 
FOR  TRACKING,  AT  MONTEREY,  CALIFORNIA 


The  adaptive  process  we  have  been  describing  in  this  paper  is 
being  "Installed"  on  a dual-processor  minicomputer  system  at  the  Naval 
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Environmental  Prediction  Research  Facility,  in  Monterey,  California. 

The  system  is  presently  operating  on  the  CDC  6400  at  SRI,  and  extensive 
plans have  been  laid,  including  dual-site  (SRI/NEPRF)  capability  and 
smooth  transfer  to  an  interactive-display  facility,  supported  by  two  NOVA- 
800  computers.  This  system  is  called  SPADS  (SATDAT  P^rocessing  And  Dis- 
play ^stem).  Fortunately,  both  computers  have  FORTRAN  compilers,  but 
incompatibility  between  CDC's  FORTRAN -ext ended"  and  Data  General's 
Fortran  IV  has  required  many  special  modifications.  These  incompati- 
bilities have  been  minimized  by  means  of  a conversion  program,  developed 
and  operational  at  SRI. 


IV  CONCLUSIONS 

The  author  feels  that  this  adaptive  process  is  the  most  effective 
operational  algorithm  existing  today  for  tracking  cloud  motions.  Another 
Interesting  and  useful  system  is  being  implemented  by  the  Space  Science 
and  Engineering  Center  at  the  University  of  Wisconsin,  but  their  emphasis 
is  more  on  human  guidance  for  cloud  tracking,  and  is  thus  not  an  auto- 
matic or  objective  system.  There  is  no  automatic  clustering  process 
in  the  Wisconsin  system:  "Only  candidate  clouds  identifiable  by  the 
scientist  throughout  the  picture  sequence  were  tracked. The 
correlation  method  being  used  by  the  National  Environmental  Satellite 
Service  seems  to  be  less  accurate,  because  fixed  background  is  not 
separated  from  moving  clouds.  With  the  increasing  use  of  satellite 
weather  pictures,  it  is  appropriate  that  the  most  promising  methods  of 
tracking  should  be  thoroughly  investigated.  Furthermore,  the  study  of 
the  navigation  of  clouds  is  most  appropriately  a naval  function. 
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